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Abstract 

If L is a bounded linear operator mapping the Banach space X into the Banach space Y 
and A is a compact set in X, then the Kolmogorov widths of the image L(K) do not exceed 
those of K multiplied by the norm of L. We extend this result from linear maps to holomorphic 
mappings u from X to Y in the following sense: when the n widths of K are 0{n ~ r ) for some 
r > 1, then those of u(K) are 0(n~ s ) for any s < r — 1, We then use these results to prove various 
theorems about Kolmogorov widths of manifolds consisting of solutions to certain parametrized 
PDEs. Results of this type are important in the numerical analysis of reduced bases and other 
reduced modeling methods, since the best possible performance of such methods is governed by 
the rate of decay of the Kolmogorov widths of the solution manifold. 


1 Introduction 


In all that follows X and Y are complex Banach spaces. If A is a compact set in X, then the 
Kolmogorov n-width 

d n (K)x'■= inf max min Ip — w\\x- (1. 

dim(W)=n v&K wGW 

of K in X measures how well the set K can be approximated by n dimensional linear spaces. 
Obviously, if L is a bounded linear mapping of X into the Banach space Y, then the image L(K) 
is compact and its n-widths satisfy 

dn(L(K)) Y < \\L\\d n (K) x , n> 1. (1.2) 

The purpose of this paper is to study how the asymptotic behavior of these n-widths is preserved 
under the action of mappings u that are possibly nonlinear but assumed to be holomorphic. 

We say that u is holomorphic on the open set O C A if for each x G O, u has a Frechet 
derivative at x. Our main result is 

Theorem 1 Suppose u is a holomorphic mapping from an open set O C X into Y and u is 
uniformly bounded on O: 

sup ||n(x)||y < B. (1.3) 

x&O 

If K C O is any compact subset of X, then for any s > 1 and t < s — 1, 

sup n s d n (K)x < oo =>- supn < d n (n(A))y < oo. (1.4) 

n>1 n >1 
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We prove Theorem Q] in the following sections ^2] and ^3j Roughly speaking, this result says that 
holomorphic mappings behave almost as nicely as linear mappings, in the sense of transporting the 
asymptotic behavior of n-widths. In the theorem, we have a loss of slightly more than 1 in the 
rate since it is asked that t < s — 1. It is not clear whether this loss is unavoidable, or just tied to 
our method of proof of Theorem [[] which is based on local parametrizations z H > a(z ) of K, where 
z = o is a sequence of complex numbers, and piecewise polynomial approximations applied 

to the resulting map z (->• u(a(z)). 

Our motivation for seeking theorems of this type lies in the study of parametric families of 
Partial Differential Equations (PDEs), of the general form 

P(u,a) = 0, (1.5) 

where V is a partial differential operator, and a is a parameter that varies in a compact set K of a 
finite or infinite dimensional space X. Assuming well-posedness of the problem, in the sense that 
for every a € A there exists a unique solution u(a) in a suitable Banach space Y, we may define 
the solution map 

u : a i—^ u(a), (1.6) 

acting from K to the solution space Y. Various applications typically require the query of u(a) for 
many instances of the parameter a. 

The objective of reduced modeling is to build efficient online methods for such numerical queries, 

by exploiting the smoothness of the above solution map. One approach consists in searching for an 

optimal space V n of moderate dimension n for simultaneously approximating all functions in the 
solution manifold 

u(K ) := { u(a ) : a € K}. (1.7) 

Therefore, the asymptotic behaviour of the n-width d n (u(K))y gives us the best possible perfor¬ 
mance of such an approach. Of course, the optimal space V n is generally not accessible. 

For instance, the reduced basis method mm generates V n from particular snapshots m = 
u(a l ), i = 1 ,n, of the solution manifold. These spaces are not optimal, however it has been 
shown in [I] and [Sj that, in the case where Y is a Hilbert space, whenever d n {u{K))y is 0{n~ r ) 
then a certain greedy selection of the a 1 in the reduced basis method gives the same convergence 
rate for the spaces V n generated by the algorithm. The performance of other model reduction 
methods such as the generalized empirical interpolation method [12j or the generalized reduced 
basis methods [9] can also not exceed the rate of decay of the Kolmogorov width of the solution 
manifold. This motivates our interest in evaluating the asymptotic behaviour of the n-widths of 
the solution manifolds associated to relevant parametric PDEs. 

While the n-width of K is typically easy to estimate, that of u(K) is not, due to the generally 
nonlinear nature of the solution map, and a certain decay of d n {u{K)y) is often used as starting 
assumption in the analysis of model reduction, but rarely proved. Therefore results like Theorem 
0 ] are useful in order to provide a-priori bounds provided that the solution has holomorphic with 
respect to the parameter. We apply this approach to various examples of parametric PDEs in 0 

2 The proof of Theorem jT] 

In what follows, we use the notation 

U:=® 3 >i{\zj\<l}, (2.1) 
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for the unit ball of the complex space 4x>(N). The proof of Theorem [T] will be reduced to proving 
the following theorem. 

Theorem 2 Let K,0 and u be as in the assumptions of Theorem [/] Assume that, for some p < 1, 
there exists a sequence {ifj)j> 1 of functions in X such that 

(\\^j\\x)j>i G £p(N) and K C Q := j ^ Zjipj : z = (zj)j> i G C/| (2.2) 

f>i 


Then 


^^nf d n {u{K))Y] p n 1 < oo, t, := -1. 

n> l ^ 


(2.3) 


We prove Theorem [2] in the following section. For now, we show how it implies Theorem [TJ 


Proof of Theorem [l] from Theorem [2} The assumption in Theorem [T] is that 


sup n s d n (K)x < oo, (2.4) 

ri> 1 

where s > 1. Therefore, there exists a constant C > 0 and a sequence of spaces (14)fc>o with 
14 C X and dim(14) = 2 fc , such that 

max min llx — g\\x < C2~ sk , k>0. (2-5) 

xgk g ev k " _ 

By replacing Vj. by Vq + V\ + ■ ■ ■ + V4_ i and possibly changing the constant C, we may assume that 
the spaces 14 are nested: 14-1 C 14 , for all > 1. 

Now let x G K, and denote by bk a best approximation to x from 14, k > 0, and dehne 6_i := 0. 
Then, gk := bk — 6fc-i is in 14, k > 0, and we have 

x = ^2gk, ( 2 . 6 ) 

k>0 

and there exists a constant C > 0, such that 

\\9k\\x<C2- sk , k> 0 (2.7) 


By Auerbach’s lemma (see page 146 of 0), for every k > 0, there exists a basis Wk,l}i—i... 2 k °f 
the space 14, and a dual basis {<fk,i}i=i 2 k T X' such that H^zII.y = ||ty4,z||x' = 1- It follows 
that any x G K is of the form 

2 k 

X = Zk,lTk,h \zk,i\ < C2~ sk . (2.8) 

k >o ;=i 


Each integer j > 1 can be written uniquely as j 
define 


4,- := C2- s Vm 


= 2 fc + l — 1 with 

j = 2 fe + l — 1. 


G {1,..., 2 fc }. We use this to 

(2.9) 


This gives that any x £ K is of the form 


x = N < L 

j> i 


( 2 . 10 ) 
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Therefore, we have 


( 2 . 11 ) 


and in addition 


I< C Q := | ^Zjifj : z = {zj) 3 >\ £ 1/ }, 

3 > 1 


ll^iu<2 s cr s - 


( 2 . 12 ) 


It follows that (||'0j||x)j>i £ ^p(N) fo r any p such that sp > 1. Therefore, according to Theorem^ 
we obtain that 

y^[n t d ri ('u(-fr))yFn -1 < oo, t :=-1. (2.13) 

/s ' p 

n>l y 

It follows that 

sup r\?d n {u(K))Y < oo, (2-14) 

n> 1 

for any t < s — 1, which is the conclusion of Theorem [T] □ 


Remark 3 The loss of 1 between s and t is inherently linked with the particulars of the above 
argument, which replaces the compact set K by the larger set Q which has a simple geometry of a 
rectangular box with directions if j. The loss occurs when going from the assumption d n (K)x < n~ s 
of the Theorem to the property that ||Vh'||x ~ j~ s ■ If we try to reverse this argument without any 
other assumption than Hj\\x < j s , we may only retrieve that 

d n {K)x < d n (Q) x < ^ Hj\\x < n l ~ s . (2.15) 

j>n 

3 Proof of Theorem [2] 

This section of the paper will give the proof of Theorem [2j The assumption in the theorem says 
that each x £ K is in Q and can therefore be written as 

OO 

x = ^2 Zj'tfj, (3.1) 

3 = 1 

where z = {zj)j>\ £ U and (\\ifj ||x)j>i € ^ P (N). The main idea for the proof of Theorem [2] is 
to use the parametrization of K by z = {zj)j> o, and piecewise polynomial approximations of the 
resulting map 

z u(a(z)), a(z) :=22zjifj, (3.2) 

3 > 1 

from U to Y. The first problem that we face is that this map is generally not well defined for all 
y £ U due to the fact that the set a(U) is generally not contained in the open set O where u is de¬ 
fined and known to be holomorphic. We will remedy this situation by using local parametrizations 
of K, taking advantage of its compactness. 
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Step 1: localization 

Since K is compact and O is open, there exists an e > 0 such that the open set 

K e := {x £ X : min ||x — x'\\x < s} = [J {x : \\x — x'\\x < £}, (3.3) 

31 &K x'€K 

is contained in O. With no loss of generality, up to choosing a smaller O, we may assume in what 
follows that O = K e . 

For this e, we next choose J > 1 such that 

£lWU<^. (3.4) 

j>J 

Such a J always exists since (||V’jl|x)j>i € ^ P (N) C ^i(N). In going further, we use the notation 

Uj := {z £ U : Zj = 0, j > J}, (3.5) 

where U is defined by (12.111 . Since K C Q, for any x € K there exists a z £ U such that 


J 

x = ^2 Zjt/jj + ^2 Zjiftj =: xj + xji. (3-6) 

j =i j>J 


Note that this decomposition may not be unique - since the ipj are not assumed to be linearly 
independent - but, for each x £ K, we assign one such decomposition. 

We can find a finite set U'j C Uj, such that, for each 2 £ Uj, there is a z' € U'j such that 


\z — z / 

I I IFo 


< rj, r? : = 


10 Ej=i Hj\\x 


(3.7) 


We let B := {b \,..., 6m} be the finite set of points 6 = Ylj=i with z ' £ U'j , for which there is 
an x = Zj^j U, such that 


Zj-Zj\<rj, j = l,...,J. 


(3.8) 


Now, define the sets 

J 

Qi := 16,; +V^2 z j' l h + X/ Z ]' l h ■ Z€U j, i= 1, 


, M. 


(3.9) 


We claim that 


j = 1 i>J 


M 


Kc\jQiCK e . 


(3.10) 


i —1 


Indeed, if x £ K and x = z jipj, then according to (13.711 and (13. 81) . there is a 6, such that 


J 

xj-bi = y~] Cjlpj, \Cj\ < T], 
3 = 1 


(3.11) 
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and so the left containment easily follows. To prove the right containment, we fix i € {1,..., M} and 
verify that Qj C K e . We have bi = J2'j= 1 z 'j^ 3 i an d from (13.81) . there is an x* € K, x* = z*ipj 

for which Hz' — £*||^ 00 ({i_m < V- In view of (13.41) and the definition of r/, we have 

ll».-i*ILv<|. (3.12) 

This means that for any point x € Qi, we have 


, I -,.| U< i„ i _ I .| U+ ± + ±<! 


(3.13) 


because both terms 77 J2'j= 1 z i l l ) i and ^j>J appearing in (13.91) each have norm less than ^ 
with strict inequality for the second term. Since x* G K, this shows the upper containment in 
(l3TT0l) . 

Let us define the new sequence ('t/I*) by 


./.* . = f Vi’j, j = !,■■■, J, 
1 ' 1 Vh, J > J- 

Then, (||'0* , ||x).j>i £ f? p (N) and in addition 

00 % 

EiWiusio- 

3 = 1 

Hence, each of the sets Qj, for i = 1,2,..., M, is of the form 


(3.14) 


(3.15) 


Q* = {6 + ^^* : 2 ; = (zj)j>i £(/}, &GH, (||^|U),->i €* p (N). (3.16) 

3 = 1 


We note for further use, that 
about Q*, namely 


because we have shown (13.131) , we actually can conclude slightly more 
Q*e-= jz : dist(x,Q*)x < C K e . (3.17) 


From ()3.10l) . we have 


M 

u(K) c [J u(Qi). 
1=1 


(3.18) 


Therefore, dMn(u(K))Y < max d n (u(Qj))y. In order to conclude the proof of the theorem, it 

will be sufficient to show that for every set Q* of the form ()3.16j) which satisfies (13.171) and (13.151) . 
we have 


y^(n t d n (u(Q*))^n 1 < 00 , t := -1. (3.19) 

p 

n> 1 ^ 
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Step 2: parametrization and holomorphic extension 

In order to prove (J3.19I) and complete the proof of the theorem, we fix such a set Q* having the 
representation (13.161) and satisfying ()3.17l) and (13.151) . We consider the Y valued function 


v(z) := u(b + z j^j)- (3.20) 

3 = 1 

If p = (pj)j> i is any sequence of positive numbers such that pj > 1 for all j > 1, we introduce the 
polydisc 

U p := <8>j>i{kjl < Pj}- (3-21) 

Our next observation is that if the sequence p is such that 

£(ft- 1 )N’-|lx<|, (3.22) 

3> 1 

then, by the definition of Q* and because of (|3.17l) . the function v is holomorphic in each variable 
Zj and bounded on the set U p , with 

||u(z)||y < B, z € Up. (3.23) 

We expand v in terms of the multivariate power series 

v( z ) = X] VvzV > z '' := II z ? ’ ( 3 - 24 ) 

v&T j >1 


where T is the set of finitely supported sequences of positive integers v 
coefficient 


v v : = 


1 ff'i 

V\~dz l 


:( 0 ), 


- n 

3> 1 


Uj\ 


, and each 


(3.25) 


is an element of Y (here, we use the convention that 0! = 1). 
the expansion (|3.24l) satisfy 

(|| w || y)v&f e ^(- T 7 )- 


We will show that the coefficients in 

(3.26) 


Assuming that this claim has been proven, we show how to finish the proof of (13.191) . Indeed, we 
define A n C T to be the set of indices corresponding to the n largest ||u„||y. Then, a standard 
result of best n-terrn sequence approximation j5j says that (13.261) is equivalent to 


^ ||w||y^ n 1 < oo, t := -1. (3.27) 

ra> 1 ^ 


Since the subspace Y n := spanju^ : v G A n } of Y provides the estimate 


d n (u(Q*))Y < nrax min ||rt( x ) — w ||y < max v(z) — > v v z h 

X&Q* W&Y-n z€U z —' 


< 


y 


E 


\V V My, 


(3.28) 


we conclude that (|3.19l) holds. 

We are left with having to prove (I3.26p . The proof of this claim follows by arguments borrowed 
from [3j- We will only sketch the details and leave the reader to consult [3] when the proofs are 
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identical. We establish (13.261) by proving certain estimates for the norms ||rv||y. If p = (pj)j> 1 is 
any sequence such that pj > 1 and such that 

^(Pj ~ l)Wj\\x < (3-29) 

o> i 

then, we follow the approach in [3] (based on applying the Cauchy integral formula over the discs 
{\zj\ < pj} for each variable), to obtain the estimate 

\K\\y<bUpP=Bp-\ (3.30) 

i> i 


with the convention that pj = 1 if Vj = 0. 


Step 3: summability 

We use the estimate (13.301) to establish the ^(J 7 ) summability of the sequence (HMMi/g.f. To this 
end, we use a specific design of the sequence p that depends on the index z/, in a similar spirit to 
that in [3]. We introduce the sequence p(v) := (pj)j >i that depends on v according to 


Pj : = 


6e Vj 

+ loUV’jlU M 


(3.31) 


where \u\ := X)j>i Pr ^ is easily checked that Ylj>i(Pj ~ l)||^j||x = f§, so that the estimate 

(13.301) holds for p = p{v). Consequently, defining the sequence d = (dj)j >i with dj := — ^4 — . we 
obtain 

\K\W<B]l(^d,y = ^d 1 ', (3.32) 

j> 1 J 

Using the inequalities n! <n n < n\e n , which hold for any n > 1, it follows that 


Mly < 

v\ 


(3.33) 


where d is defined by dj = edj. We notice that 


Y, <J i 

j> i 


j >i j >i 


10 2 e e , 

Y < e -= — < 1. 

1 “ 6s 10 3 


(3.34) 


We then invoke Theorem 7.2 in |4j which says that the sequence (^| -d u )^ £ jr belongs to ^(J 7 ) if and 
only if d £ £ p (N) and < 1. This completes the proof of Theorem [2j 


4 Application to parametrized PDE’s 

Parametrized PDE’s are of the general form 


V(u, a) = 0 , 


( 4 . 1 ) 











where V is a differential operator and where a represents parameters in the model. Typically a is 
a function that could represent a diffusion coefficient, source terms, speed of propagation, shape of 
the boundary of the domain where the problem is set, etc. We allow a to vary in a set K such that 
the solution u(a) is well defined in some Banach space Y for all a € K. 

We are then interested in the the solution manifold, 

u(K) := {u(a) : a E K} C Y. (4.2) 

As explained in the introduction, one reason for estimating the decay of the n-widths of u(K) is 
that it allows us to give a-priori bounds for the convergence of model reduction methods, such as 
the reduced basis method. 

As a first example, we consider the problem 

— div(aVre) = /, (4.3) 

set on a bounded Lipschitz domain D C M m , with homogeneous Dirichlet boundary conditions and 
/ € H~ 1 (D). We are interested in the map 

u : a —* u(a). (4.4) 

Here we take X = L°°(D), Y = Hq(D), O = {a £ X : 3fJ(a) > r}, where r > 0 is fixed, and K a 
compact set of X contained in O. 

We can use Theorem [l] to estimate the decay of the Kolmogorov n-width of the solution manifold 
u(K) from the decay of the Kolmogorov re-width of K. The holomorphy and boundedness of the 
map u from O to Y follows from standard arguments using Lax-Milgram theory, see for example 
[3]. In fact the expression of the complex Frechet derivative du a : X —> Y can be obtained by 
differentiating the variational form 

J aV(re(a))Vu = (f,v), v£Y (4.5) 

D 

with respect to a: for any w G X, we find that du a w € Y is the unique solution to 

J aV (du a w)Xv = — J wV(u(a))Vv, v€Y. (4.6) 

D D 

As to the boundedness, we have the standard a-priori estimate 

Ma)||y a € O, (4.7) 

where Y' is the dual space of Y, in this case Y' = i7^ 1 (Z?). It follows from Theorem [l] that for any 
s > 1 and t < s — 1, 

sup n s d n (K)x < oo => supre t d n (re(A'))y < oo. (4.8) 

n>1 n>l 

As an example consider, for some fixed a, M >0, the set K defined as 

K := {a € X : 9f 1(a) > r, ||a|| c « < Af}, (4.9) 
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where C a (D) = L>^(L°°(.D)) is the Holder space of exponent a > 0, equiped with its usual norm 
|| • ||ca. It is well known that the Kolmogorov n-widths of the unit ball of C a (D ) decay like n~ s 
where s = It thus follows that 

sup))y <00, t < — — 1. (4-10) 

n> 1 ?Tl 

It is possible to treat more general models of the form (14.ip . in particular non-linear PDE’s, 
through the following general theorem, which uses arguments similar to those in the proof of 
Theorem 2.4 in f2|. 

Theorem 4 Let V : Y xI^Z where X, Y and Z are complex Banach spaces. Let K C X be 
compact set of functions. We assume that 

(i) V is a holomorphic map from Y x X to Z. 

(ii) For each a £ K, there exists a unique solution u(a ) £ Y to m- 

(in) For each a £ K, the partial differential d u V(u(a),a) is an isomorphism from Y to Z. 
Then, there exists an open set O C X containing K, such that u has an holomorphic extension 
over O with values taken in Y and a uniform bound sup aGO ||it(a)||y < B. In other words, all the 
assumptions of Theorem 1 hold. 

Proof: Let a £ K. The assumptions (i)-(ii)-(iii) allow us to apply the holomorphic version of the 
implicit function theorem on complex Banach spaces, see [8] Theorem 10.2.1], and conclude that 
there exists an e > 0, and a unique holomorphic extension of u from B(a,e ) the open ball of X 
with center a and radius e into Y such that V{u{b),b) = 0 for any b £ B(a,e). In addition, the 
map u is uniformly bounded and holomorphic on B(a, e) with 

dub = — (d u V(u(b), b)^ o dVb{u(b), b), b£B(a,e). (4-11) 

Let us note that e = e(a) depends on a. Since [j aeK B( a ,e(a)) is an infinite open covering of K 
and since K is compact in X, there exists a finite number M and a\, ■ ■ ■ , om in K such that 

M 

K C O := [J B(aj,£(aj)) . (4.12) 

l=i 

Therefore u has a uniformly bounded holomorphic extension over O. □ 

There are many settings where Theorem [4] can be applied. These include equations where the 
dependence of V in both a and u is nonlinear, in contrast to the previous example of the linear 
diffusion problem. As a simple example consider the equation 

u 3 — div(exp(a)Vu) = /, (4-13) 

set on a bounded Lipschitz domain D C M m where m = 2 or 3, with homogeneous Dirichlet 
boundary conditions and / £ H~ 1 (D). Here, we set X = L°°(D), Y = Hq(D) and Z = H~ 1 (D) = 
Y'. The operator V is given by 

V{u,a) = u 3 — div(exp(a)Vu) — /. (4-14) 
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Using the fact that Hq(D) is continuously embedded into L 4 (D), it is easily seen that V acts as a 
holomorphic map from Y x X to Z, and therefore assumption (i) holds. 

We now take for K any compact set of X contained in the set of real valued functions a £ X. 
By the theory of monotone operators, see for example Theorem 1 in Chapter 6 of m, for any 
a £ K there exists a unique solution u(a ) to (14.131) . and therefore assumption (ii) holds. 

Finally, we observe that, for any a £ K, we have 

duP(u(a),a)(w) = 3u(a) 2 w — div(exp(a)Vu;). (4-15) 


The operator d u V(u(a),a) is associated to the sesquilinear form 

cr(y,w) = {d u V(u(a),a)(v),w) Y ',Y = / 3 u(a) 2 vw + j exp(a)Vu • Vw. (4.16) 

D D 

which is continuous over Y xY (by the continuous embedding of Hq(D) into L i (D)) and satisfies 
the coercivity condition 

cr(v,v) > exp(-||a||L°°)|| , u||y, v £ Y, (4.17) 

By Lax-Milgram theory, d u V(u(a),a) is thus an isomorphism from Y onto Y' = Z, and therefore 
assumption (iii) holds. 

In conclusion, we may apply Theorem U and subsequently Theorem [1] to conclude that 


sup n s d n (K)x < oo supn*d n (u(iF))y < oo. 

n>1 n>1 

For example, if K is of the form 


we again obtain that 


K :={a£X : ||a|| c «* < M}, 


Qt 

supn < d n (ri(A"))5- < oo, t < -1. 

n> l m 


(4.18) 


(4.19) 

(4.20) 
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